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Abstract. We prove the composition and L 2 -boundedness theorems for the 
Nagel-Ricci-Stein flag kernels related to the natural gradation of homogeneous 
groups. 

In [3], Nagel, Ricci, and Stein introduce a notion of a flag kernel which gener- 
alizes that of a singular integral kernel of C alder on- Zygmund as a tool in their 
investigation of operators naturally associated with the db on some CR submani- 
folds of C n x C n . A flag kernel K on a Euclidean vector space V endowed with a 
family of dilations and a corresponding homogeneous norm x — > \x\ is a tempered 
distribution associated with gradations 

3=1 3=1 

of the space and its dual. The Fourier transform of K is required to be smooth 
for £r ^ and satisfy 

(o.i) \D a m)\ <c^ ai W a ^---\^ aR \ 

where 

R R 

k=j k=l 

and aj are submultiindices corresponding to the spaces V*. Actually, the au- 
thors define the flag kernels directly in terms of the smoothness and cancellation 
properties of the kernels, and then prove that the multiplier condition (jO.ip is an 
equivalent possibility of definition. 

They prove that if V is the Lie algebra of the homogeneous group identified 
with the group itself, dilations are automorphisms of the group, spaces Vj are 
homogeneous, and [Vj, Vk] = {0} for j ^ k, then the composition of flag kernels 
associated with the same gradation is still a flag kernel. Moreover, under the 
same hypotheses any flag kernel K defines a bounded operator 

Kf(x) = f*K(x)= [ f(xy)K(y)dy 
Jv 

on L P {V) for 1 < p < oo. 

A natural question arises, whether the composition and boundedness properties 
still hold if the underlying gradation is the natural one of a homogeneous group. 
Note that for homegeneous groups of step bigger than 2 the commutator condition 
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is no longer satisfied. We provide an answer in the affirmative under somewhat 
relaxed assumptions on the kernels and p = 2. 

The results presented here depend heavily on the symbolic calculus of pQ and 
can be regarded as an example of usefulness of such a calculus. There occurs a 
striking resemblance between the estimates defining flag kernels and those of the 
calculus which has been created and developed quite independently. 

The problem of the L p -boundedness of flag kernels on arbitrary homogeneous 
groups will be dealt with in another paper [2]. 

I wish to thank Fulvio Ricci for a fruitful conversation concerning the subject 
of this paper. 

Even though I had no opportunity to discuss the subject matter of this paper 
with Andrzej Hulanicki, it unavoidably bears signs of his influence which can be 
traced back throughout the whole of my mathematical work. 



1. Background 

Let q be a nilpotent Lie algebra with a fixed Euclidean structure and q* its 
dual. Let {5t}t>o, be a family of group dilations on q and let 

Qj = {x G g : S t x = t d Jx}, l<j<R, 

where 1 = d\ < d,2 < ■ ■ ■ < <1r. Then 

R R 

(i-i) = 00;, 0* = © 



°3' 

3=1 3=1 



and 



\n „ 1 r J ^' ^ ^ ~*~ — dk, 

where V = {dj : 1 < j < R}. Let 

R R 

^Ki = £iioii 1/di = Ey 

3=1 3=1 

be a homogeneous norm on g*.. We say that g is homogeneous of step R. 

We shall also regard q as a Lie group with the Campbell-Hausdorff multipli- 
cation 

xix 2 = x\ + x 2 + r(xi,x 2 ), 

where 

r(x 1 ,x 2 ) = ^[x 1 ,x 2 ] + Jod^ 1 ' [^I'^a]] + [x2, [x2,xi]}) 

+ ^[X2,[ x ld x 2,xi}}} + ... 

is the (finite) sum of terms of order at least 2 in the Campbell-Hausdorff series 
for g. 
Let 

R 

\C\j = J2\^ !<i<^> 

k=j 

and let |^|_r+i = 0. Let 

R I, n 
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be a family of norms (a Hormander metric) on g*. Let gj be a family of functions 
on g* satisfying 

and 

for some C > and M > 0. The metric q is fixed throughout the paper (cf pQ). 

The class S m (g), where m G R, is defined as the space of all ^4 G <S'(g) whose 
Fourier transforms are smooth and satisfy 

\D a A(0\<c a (i + \t\) m nf =1 (i + gj (0r^, (eg\ 

where a = (a%, . . . , or) is a multiindex of length equal to the dimension of g*, 
and ctj are submultiindices corresponding to the subspaces g*j. Note that the 
elements of S m (g) have no singularity at infinity. 

The space S m (g) is a Frechet space if equipped with the seminorms 

\\A\\ a = sn P Uti(l + gk(0) H \D a m\- 

The class S°(g) is known to be an subalgebra of B(L 2 (g)). More precisely, we 
have the following two propositions proved in pQ. 

Proposition 1.2. The mapping 

S mi (g) x S m2 (g) 3 (A, B) ^ A * B € S mi+m2 (g) 

is continuous. 

Proposition 1.3. If A G S°(g), then 

Op(A)f(x) = [ f(xy)A(dy), f e 5(g), 

extends to a bounded operator on L 2 (g), and the mapping 

S°(g) 3A^ Op(A) G B(L 2 (g)) 

is continuous. 

2. Main results 

We extend the definition of a flag kernel of Nagel-Ricci-Stein to include all 
K G S'(g) whose Fourier transforms are smooth for £r ^ and satisfy 

(2.1) 1^(61 < c a uf =l9j (0' laj] , + o, 

where the weight functions defined above are now additionally assumed to be 
homogeneous. Note that for gj(£) = we get the usual flag kernels. An- 
other interesting choice is gj(£) = In the latter case the estimates of the 
derivatives in the direction of £r are irrelevant. Observe that if 

<K t ,f>= [ f(tx)K(x)dx, 

then the flag kernels Kt satisfy the estimates (|2.ip uniformly in t > 0. 

We shall need two cut-off functions. Let ip G C°°(g^) be equal to 1 for 1 < 
< 2 and vanish for \£ R \ > 4 and \£ R \ < 1/2. Let ip G C°°(g R ) be equal to 1 
for 1/2 < < 4 and vanish for |^| > 8 and < 1/4. Thus, in particular, 
ip ■ ip = cp. 

Theorem 2.2. A composition of flag kernels is also a flag kernel. 



Flag kernels 



4 



Proof. Let K = K\ ★ K2, where Kj are flag kernels. Then 

k{0 = £7a 2 (£), i<\Sr\<2, 

where 

and Aj € 5 , °(g). Therefore, by Proposition 11.21 

(2.3) \D a K(0\ < C a Uf =l9j (0-^ 1 , 1 < \Zr\ < 2. 
Since 

(2.4) (Kjj~ t (Z) = KjitS), t>0, 

satisfy uniformly ()2.ip . we get the estimate (|2.3p for 1/t < < 2/t, t > 0, that 
is, for all £i? ^ 0. □ 

Theorem 2.5. Lei K be a flag kernel. The operator f —> f * K defined initially 
on S(q) extends uniquely to a bounded operator on L 2 (q). 

Proof. For / G 5(g) let 
Then 

00 

m||/|| 2 < ll/n||2<M||/|| 2 , feS(g), 

n=— 00 

for some m,M > 0. Let K n be defined by 

K n (0 = K(^(2- n i R ). 
Then the flag kernels L n = (K n )2^ are uniformly in S°(q), and 

||Op(*Q/|| 2 <i V||Op(iT n )/ n || 2 
m z — ' 

neZ 

= 1 V2"«/ 2 ||Op(L„,)(/„) 2 n|| 2 <^ V2"«/ 2 ||(/„) 2 ,|| 2 
m ^-^ m ^-^ 

neZ nGZ 

<^Eii/^<^imb 

m m 

neZ 

for a C > 0, which completes the proof. □ 
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